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ABSTRACT 



Programmed instruction was first developed in the 1920 's and 
has been used quite extensively since World War II, The increasing 
necessity for efficient and effective utilization ©f men, manpower 
and money requires the introduction, both in civilian industry and 
the Navy, of any tool which will accomplish this end. The use of 
programmed instruction by private enterprise is increasing and 
shows promise of helping to further achieve the profits by which 
success is measured. The Navy has made several effectiveness 
studies of programmed instruction. However, the recent develop- 
ments and available courses point out many areas in which the Navy 
can benefit from civilian accomplishments. 
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CHAPTER I 



PART I. BACKGROUND 

For most business corporations, the period immediate- 
ly following World War II was exemplified by high consumer 
demands, a minimum amount of competition and excellent pro- 
fits. Although the recession of 1949 eliminated some of 
the marginal producers, the high governmental expenditures 
of the Korean Crisis eased the competitive pressure. By 
the middle and late Fifties many firms had had to go through 
a serious self-appraisal of their management methods to de- 
termine the manner in which their competitive position and 
profit outlook could be best improved. 

One of the functions which has of late come in for in- 
creasing investigation is the training of personnel. The 
"impetus of the "management trainee" program coincided with 
the influx of G.I. students to the labor market from about 
1948 to 1955* In many cases the program existed in name 
only and therefore can be considered to have been only par 4 " 
tially successful. In reality it was just another name ap- 
plied to the training of the white collar worker. Most 
training of blue collar employees was loosely defined as 
"on-the-job training" with no formal training program in- 
volved. 



1 



Programmed instruction is one of the refinements 
that has been expanded upon since World War II in the ef- 
fort to increase the return for the training dollar and/or 
to increase the output received for the same dollar input. 
As may be expected, not all corporations have had the same 
results with programmed instruction and many feel the na- 
ture of their business or the increased costs of initially 
installing some type of programmed instruction would ex- 
ceed the benefits. 

A review of the information available on the subject 
of programmed instruction and aids seems to fall into one 
of two categories. Experts support the use of programmed 
aids and instruction in its many forms. Its virtues are 
extolled in opinions ranging from acceptance as another 
worthwhile aid in performing a training function to advo- 
eating the teaching machine as the ultimate in education- 
al instruction. 

The opposite side of the coin is represented by the 
many people who feel that the lack of personal contact far 
outshadows the benefits that may be obtained through use 
of programmed instruction. As a result most of their ani- 
mosity is focused upon the teaching machine because this 
method involves the least personal contact. Most of the 
information reflecting these views is to be found in pub- 
lications covering the educational field. Rightly or 
wrongly many advocates of programmed instruction contend 
this opposition is due to an improper understanding of the 
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teaching machine and its use and the fear of job security 
by the marginal teacher* 

The opinions favoring the use of programmed instruc- 
tion can be found in several types of journals and period- 
icals. Educators, psychologists and industrial training 
personnel have all written articles advocating its employ- 
ment. The fact that the ''pro'’ rather than the "con” arti- 
cles appear in special journals is understandable as their 
purpose is instructive rather than destructive. The "con" 
articles are usually to be found in popular periodicals or 
general opinion type periodicals. 

Several misconceptions exist in the people's minds as 
to what programmed instruction is, what it will or will not 
do, how it is being used today and what are future predic- 
tions. It is not true that programmed instruction depends ^ 
upon a mechanical device known as a teaching machine. Tea- 
ching machines are one method of presenting Information. 
Depending upon the source of the machine it can vary from 
a cardboard frame to a complex electronic device. In addi- 
tion to the hardware used to present the training, there 
are linear textbooks and scrambled textbooks as methods of 
presentation. 

Many misinformed people, among them Educators and in- v 
dustrial trainers, understand the purpose of programmed in- 
struction and the teaching machine is to eliminate the hu- 
man instructor. This belief is definitely incorrect as 
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programmed instruction is intended to supplement training 
and free the instructor from some of the routine tasks. 

In this manner a better grade of instruction will result 
for more time may be devoted to complicated teaching dut® 
ies and special assistance where required. 

Another common misconception is that programmed in® 
struction is designed primarily for the trainee who has 
had a minimum of formal education. This statement is de® 
finitely false. One only has to consult Appendix G- to 
see that the courses vary from graduate level courses of a 
complex and technical nature to fundamental mechanical 
operations and basic Information courses. The degree of 
formal education required for an industrial training course 
is generally related to the task and not the individual. 

Contrary to many beliefs , a corporation does not have 
to be large or wealthy to use some form of programmed in® 
struction. The amount of money invested is entirely de- 
pendent upon the form of training aid that is decided upon. 
Programmed textbooks are relatively inexpensive but some 
complex machines can cost in excess of $5»000 each. There- 
fore, the training director must carefully analyze his 
training situation in terms ofg (1) objectives, (2) the 
types of people to be trained, (3) training dollars avail- 
able, (4) number of people to be trained and, (5) how far 
are they from a central point where a teaching program 
could be established. This analysis will determine the 
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utilization that can be made of training aids and it may 
possibly reveal that programmed instruction is not the 
answer to the training problem# If it does survive this 
analysis s this examination will help in clarifying the 
real objectives and what it will take to achieve them# 

While the amount of investment in programmed instruc- 
tion need not be large it is equally true that the employ- 
ment of this form of training will not reduce overall 
training costs# The claim that can be made*, however^ is 
that proper use of effective programs will improve the 
caliber and amount of training which can be offered. 

PART II. STATEMENT OP THE PURPOSE 
The purpose of this research paper is to draw con- 
clusions as to the desirability of including programmed 
instruction in an industrial training program. These con- 
clusions will be drawn as a result of a review of informa- 
tion which has been published on programmed instruction 
and an evaluation of the use and acceptance of programmed 
aids within industry. The evaluation includes a survey ofs 
(1) industrial companies^ (2) public utilities,, (3) bank- 
ing institutions j, (4) merchandising concerns^ (5) life ins- 
urance companies and 9 (6) selected transportation companies. 

PART III. DEFINITION OF TERMS 
For the purpose of this paper the following defini- 
tions and restrictions will apply s 
PROGRAMMED INSTRUCTION— 

1. A self-contained sequence of instructional 
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items which can be presented to individual 
students under controlled conditionso It is 
designed specifically to teach material and 
is repeatedly tested and revised until it 
gives consistent and acceptable results® 

The sequence of instruction items is generally 
presented in a series of small steps thus, per- 
mitting the learner to advance one step at a 
time to more difficult and complex materials 
as he masters the preceding material® 

2. LINEAR FORMS — 

An unbroken sequence of small steps following 
2 

a single track. 

3® FRAMES — 

The unit of content of each sequential step 
■$ 

in a program. 

4. PROGRAM ~ 

Subject matter to be learned by self “instruc- 
tional method; broken into bits and arranged 

in sequence leading to maximum understanding 
4 

of the course. 

^David B. Story, "Programmed Instruction and Its 
Implication for the Training Section." Industrial Re- 
lations Training Section Bulletin of the Boeing Corp- 
oration. June 1963, p.6. 

O 

R. David Niebler, "Programmed Instruction Saves 
Time -- and Grows." Personnel Journal, Vol. 41, No. 1 
(May 1963) p. 240. 

3 Ibld . 

4 

Business Management, "A Businessman s Guide to 
Teaching Machines, August 1962, p. 44. 
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5. EXTRINSIC PROGRAMMING ~ 

A program sequence In which the steps are 
unalterable and identical for each trainee , 
not allowing for individual differences. 
(Linear program. 

6. FEEDBACK — 

After each of his responses , the learner is 
provided with information about the correct- 
ness, quality or appropriateness of his re- 
sponse. ^ 

7. REINFORCEMENT — 

The rewarding experience derived from immed- 
iate success in responding correctly to a 

7 

frame i 

8. BRANCHING — 

A program that has items built into it for 
either advanced or slow trainees. Alter- 
nate sequences give remedial practice and 
new explanations to misunderstood material. 
By this technique;, faster trainees can skip 
certain material for additional or more ad- 

O 

vanced items on the same subject. 




Theodore B. Dolmatch, Elizabeth Marting, and Robert 
E. Finley, Revolution In Training Programmed Instruction 
In Industry . Management Report Number 72, (New Yorks Amer- 
ican Management Association, 1962), p. 13. 

7 

Niebler, loc . cit . 

0 

Business Management, loc . cit . 
o 

Niebler, loc . cit . 
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9. 



SCRAMBLED BOOK — 



Q 

The branching system in book form* 

10. TEACHING MACHINE — 

A mechanism that presents information to a 

student and controls his behavior in a pre- 

10 

determined interacting relationship. In 
order to meet the criteria as developed by 
the U. So Department of Healths, Education 
and Welfare a teaching machine must accomp- 
lish five of the seven functions listed below? 

(a) Used for individual instruction 

(b) Contains and presents program content in 

steps. 

(c) Provides a means whereby the student may 

respond to the program. 

(d) Provides the student with immediate in- 

formation of some kind concerning his 
response. 

(e) Presents the frames of the program in- 

dividually. 

(f) Presents the program in a pre-determined 

sequence. ^ 

(g) It is cheatproof . x 

11. PROGRAMMED TEXTBOOK — 

12 

The teaching machine in book form. 



q 

^Niebler, loc . cit . 

^Lawrence M. Stolurow, Teaching By Machine . (Washington 
D.C.: U. S. Office of Educations, HEW, Supt. of Documents^ 
1961 ). 

■^James D. Finn and Donald G. Perrin Teaching Machines 
and Programmed Learning (Washingtons, D.C.s U. 3. Office of 
Education, HEW, Supt. of DocumentSj, 1962), p. 18. 

12 

Niebler, loc . cit . 
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The conclusions that will be drawn as a result of 
this study will apply only to the field of industrial 
training. There will be no attempt to evaluate program^ 
med instruction in the field of school education. In 
addition, industrial use of programmed instruction will 
be defined to include use within the Departmens of the 
Navy, Army, and Air Force for any phase of military and/ 
or civilian training. 
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CHAPTER II 



SUMMARY OP SELECTED RELATED SUBJECTS 
PART I THE PRESENT DILEMMA 
The point which is stressed most in any literature 
on programmed instruction is that regardless of the form 
it takes, the benefit to be gained from its use is de- 
pendent entirely upon the amount of effort and intelli- 
gence that were employed in developing the program. 

Perhaps the greatest obstacle to expansion of the 
use of programmed instruction is the need for sufficient 
well constructed and tested commercial programs. Indus- 
try interest in programmed instruction is evidenced by 
the inquiries which Business Management received to a 
house article. In the August 1962 issue of Business 
Management a feature entitled -- "A Businessman’s Guide 
to Teaching Machines" was run. Nearly 500 letters were 
received by the publication requesting further informa- 
tion on how to obtain specific training programs. ^ 

The necessity for good programs was further substan- 
tiated in almost all of the questionnaires returned by 
corporations which are employing this method of training. 

In many cases this meant internal development. For ex- 
ample, the Equitable Life Assurance Society of the United 

^Roger W. Christian, "Guides to Programmed Learning", 
Harvard Business Review a Volume 40, Number 6, November- 
Dee emberT9^2T^. 



10 



States had to spend months in planning , writing; testing 



and evaluating a twelve chapter 2500-frame program on 
"Life Insurance Fundamentals". It is true that some of 
the time initially spent in the planning function by 
Equitable was investigating the general field of program- 
med instruction and therefore would not have to be re- 
peated. Never the less, the planning step will require ^ 
study of such things ass 

1. Problem areas requiring programs. 

2. What programs are feasible (e.g. restriction 

because of the number of personnel to be 
trained) . 

3. How would this program fit into the overfall 

training program. 

4. Select the source materials. 

3* Type of training vehicle or hardware. 

6. Programming technique to be employed. 

7. Educational background of the trainees. 

P 

8. Educational objectives of the program. 

Many firms have developed fairly good cost estimates 
in both time and dollars for constructing their own pro- 
grams. This information has been arrived at as a result 
on non-availability of commercial programs or the quality 
of those that were on the market did not mset the require- 
ments of the company. Du Pont”s experience is that it 

p 

Johnr T. Childs, "How to Develop Your Own Program- 
med Instructional Materials", (a presentation before the 
American Management Association Special Conference on 
Programmed Instruction in New York City on August 27 - 29 » 
1962 . ) 
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takes three man-days to produce the equivalent of one hour 
of classroom instruction. They also feel that if a course 
can be given to 100 people the cost is justified. East- 
man Kodak's information indicates their programs take 
from 30 to 60 minutes a frame. An average program runs 
between 500 to 1500 frames requiring a minimum of 250 
hours to a maximum of 1500 hours. IBM's records indicate 
that the ratio of development hours to programs hours is 
five to one. 

Expressed in terms of dollars g estimates vary from a 
low of #4.00 per frame to a high of #30.00. To the devel- 
opment cost an amount has to be added for printing. The 
result is a total dollar cost that seldom will be less 

“Z 

than #15,000 for a good 30-hour program. 

There are instances in which a training director will 
determine that it is not practical to have his program de- 
veloped internally because there are commercial programs 
which will be adequate. In Equitable's case the program 
was tailored to fit their particular company requirements 
but a firm training a large number of employees in elec- 
tricity, for example, would be able to select from sever- 
al competent commercial developed programs. 

Because the program is available on the market does 
not necessarily mean that it is good or will adequately 

■Z 

Roger W. Christian, "Programmed Learning 1 Where 
it works, where it won't, what it costs", Factory . 

March 1962. p. 109. 



12 



perform the task for which it is intendeds The planning 
step in this case is the thorough evaluation and actual 
pilot testing of commercially developed programs to 
insure the training needs will he fulfilled. 

A well-planned text properly presented in many re- 
spects, approaches the situation of having a private 
tutor. Especially is this true when the students are 
well motivated — are really anxious to learn. Certain- 
ly this is the situation in a large company where candi- 
dates are carefully chosen for a new endeavor in the or- 
ganization, and they realize that a raise or promotion 

depends upon how quickly they learn the new task and 

4 

become productive on it. 

h 

E. F. Cooley, "Automated Teaching", Computers 
and Automation . July 1962. p« 10 0 
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PART II THE DEVELOPMENT OP PROGRAMED INSTRUCTION 

There are two schools of programming technique each 
based upon a different set of concepts of learning."^ As 
teaching are one type of instruction aid and the theory 
that is employed is the same as that used in either pro~ 
grammed textbooks or scrambled textbooks^ the discus^ 
sion that follows will deal primarily with the teaching 
machine. 

The dominant school is headed by Dr. Bo Frederic v 
Skinner s Professor of Psychology at Harvard University. 

The second school is led by Norman A. Crowder, a former 
U. S. Air Force Psychologists, who is employed by the 
Western Design Division of U. S. Industrles 9 Santa 
Barbara, California. Western Design manufactures and 
sells teaching machines and machine programs. 

Skinner's method of programmed learning is the re= 
suit of his work with animals, especially pigeons. By 
applying what he had learned to humans , Dr. Skinner de~ 
veloped a highly organized "linear form" method of teach~v 
ing based upon the theory of "conditioning." 

c 

•'George A. W. Boehm, "Can People Be Taught Like 
Pigeons?" Fortune . 62sl77, October 1962. 

6 cf. ante p. 5 
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The program is supposed to take the student by the 
. hand* as it were* and lead him every step of the way 
through a course* According to Skinner s a good pro- 
gram makes it almost impossible for a student to 
make a mistake. The subject matter is atomized into 
tiny bitSp presented to the student as a series of 
simple statements. Each idea is repeated over and 
over again, always in different words. Many of the 
statements include blanks to be filled In by the stu- 
dent with a word or two. The object is to have the 
student "participate actively in the program.” By 
filling in the blanks correctly , he "conditions" him- 
self to absorbing the information being presented to 
him. 7 

The key to this method, that of constant repetitions, 

is additionally aided by testing after each frame. If the 
student has a correct answer he is rewarded immediately 
and allowed to go to the next frame. If he errs, he is 
required to repeat the last tiny lesson. 

With the pigeons, the acts to be learned were taught 
one step at a time. Each time that the pigeon made a cor- 
rect response, it was rewarded with a kernel of corn. It 
is a basic tenet of behaviorism that behavior patterns , 
such as learning, are essentially the same for all intell- 
igent species. 

Working from this premise 9 Dr. Skinner developed his 
first programs which he tried on undergraduate students 
at Radcliffe and Harvard University in 1957. As a sub- 
stitute for the kernel of corn given to the pigeons, a 
psychological reward of feedback was given. By repeating 
the key word or phrase and allowing for feedback to the 
pupil three important concepts of psychology were put in- 
to plays 



7 



Boehm 



9 



loc c 



cit . 
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1 . 



Recall rather than recognition (recall Is trig- 
gered by a minimum of cues and is considered to 
indicate a greater degree of retention than 
does recognition). 

2. Reinforcement. 

3. Feedback for the programmer. If a pupil is 
making too many errors at any point in a pro- 
gram, it is the program, not the student, that 
is held to blame . 

Generally the machines used for presenting Skinner 
type programs are refinements of the original machine 
developed by Dr. Sidney L. Pressey, now Professor 
Emeritus at Ohio State University. In the mid- Twenties, 
when Dr. Pressey introduced his machine, his intention 
was that it would be used primarily in the field of school 
education. At that time teachers were a surplus commodity 
and there was no public pressure because of a teacher short 
age or a Russian "Sputnik" to accept new methods of instruc 
tion. Even though the principal of the first machine has 
been carried over, the hardware in which It is contained 
has been changed considerably and comes in varities costing 
from $30 to over $3,000. In 1962 there were 84 machines 
listed by the Department of Health, Education and Welfare 

O 

which met their criteria for school classroom Instruction. 
With the use of teaching machines or either type of text- 
book the three psychological concepts mentioned above are 
put into play. 

Skinner believes that any subject which can be ex- 
plained verbally can be taught effectively through pro- 

g 

United States Department of Health, Education and 
Welfare. Teaching Machines & Programmed Learning . 1962. 

p. 18. 
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grains. This does not necessarily mean machines, a] though 
that is the method he prefers for presentation* He is of 
the opinion that such learned subjects as advanced math- 
ematics are actually mechanical and are therefore subjects 
for programming and use within industry. 

The validity of this reasoning is evidenced by the 
fact that the following courses in mathematics were re- 
ported in returned questionnaires as being used by in- 
dustry; (1) General Mathematics* (2) Algebra * (3) Geo- 
me try, (4) Trigonometry , (5) Calculus* (6) Statistics* 

(7) Numbers , and (8) Boolean Algebra* 

As indicated earlier;, the program writer must under - 1 
stand both the process of learning and the subject matter 
to be taught. If this is accomplished the programmer can 
teach students to think deeply and perhaps originally. 

The program puts the student in contact with the program- 
mer* who must be superior to the average teacher accord- 
ing to Skinner. The programmer through his programmed 
teaching will be able to influence a great many more train- 
ees then training personnel can do under a conventional 
lecture type program. 

While more and more psychologists and educators are 
testing and expanding the use of programmed Instruction 
as advocated by Dr. Skinner* Norman Crowder is urging 
that his type of programmed instruction be accepted. He 
has found very little support among psychologists for his 
philosophy* which is based upon a non-behaviorlst concept 
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of learning and resembles conventional teaching much 

more than does Skinner’s. Instead of conditioning stu- 

dents to learn, he provides them with programs designed 

to serve as a private tutor. The basic difference Is 

that Crowder dispenses much more information at one time, 

often several meaningful paragraphs to a frame , rather 

g 

than atomizing this information. Major differences are s 



Crowder 


Skinner 

flWCWKOU 1 H M, IB><wMQeP 


1. Dispenses large seg- 
ments of material 


Information given in 
small bits —repeated 
often 


2. Acts as a private tutor 


Conditions students 
to learn 


3» Branching permitted 


All steps In sequence 
—no skipping 


4. Permits mistakes (tries 
to anticipate them) 


Makes it virtually 
Impossible to go 
wrong 


5. May use a multiple 
choice type question 


Trainee must con- 
struct answer 



Although Crowder's theories have not had the accept- 
ancy that Dr. Skinner's have, the former has been success- 
ful in having programs published in book form by Doubleday. 
The books, called Tutor-Texts, do not resemble convention- 
al textbooks in that the material on page two does not 
follow the material on page one.^ It may be from the 



middle of the course or the end. 


By scrambling in this 


g 

Boehm op. cit . , p. 259 





■^scrambled textbooks, cjf. ante , p. 5« 
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manner it is supposed to reduce 9 if not eliminates cheat” 
ing by the student. 

In I960 Crowder was also successful In selling 18 of 
U. S. Industries 8 $5 S 000 AutoTutor machines to the U. S. 

Air Force. These machines were used at Keesler Fields 
Mississippi to teach fundamentals of electronics to air- 
men using a Crowder developed program. 

Both psychologists are in agreement on two import” 
ant points. The first of these is that the trainee is 
allowed to proceed at his own pace. This possibility 
permits those who have difficulty with any of the mater= 
ial being presented to move as slowly as necessary. At 
the same time, the person who is able to comprehend the 
training rapidly can move right ahead. In neither case 
would the trainee invonvenlence any other student. 

The second point on which Skinner and Crowder are in 
agreement is that the best vehicle for presenting pro» 
grammed instruction is the teaching machine. They feel 
that a machine which presents the material frame by frame 
reduces cheating by the trainee. In the case of program” 
med instruction cheating has a somewhat different con= 
notation than that we usually associate with the word. 

The object of programmed instruction is to teach not quiz 
a trainee. Therefore the lazy trainee who Is working from 
a book or loose leaf papers is tempted simply to glance 
through or scan the material rather than seriously apply” 
ing himself to finding the correct solution to the problem. 
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Even though there is agreement expressed in the a» 
hove paragraphs programmed material need not he presented 
by machine to he effective* In fact 9 training directors 
returning the questionnaire seemed to favor some form of 
textbook presentation® Although no definite reasons have 
been given in most cases , it can he assumed that the ini° 
tial cost of a machine installation is the factor that 
rules out machines. 
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PART III - A POSSIBLE SOLUTION FOR THE TRAINING DIRECTOR 

A training department competes with all other de- 
partments for funds or is supported by the departments 
benefiting from the trainee's instruction* In either case 
management finds it difficult to approve the disburse- 
ment unless it can be proven that the number of trainees 
and the reoccurrence of the need warrant the expenditure. 

Regardless of the preferred method of presenting 
programmed instruction* it is the answer to three Indus- 
trial training problems. According to J. L. Hughes and 
W. J. McNamara of the International Business Machines 
Corporation* industry has always suffered from a shortage 
of qualified instructors. Generally speaking 9 this may 
be attributed to the fact that the industrial trainer is 
a highly skilled specialist* perhaps even a psychologist* 
but he lacks formal training in the field of education. 

His unintential mistakes in technical educational areas 
can destroy much of the value of his training course. 
Another associated matter faced by the industrial instruc- 
tor is inadequate time for lesson preparation as a result 
of the number of classes it is necessary to conduct to 
meet a training deadline. 

Secondly* the number of persons to be trained is so ^ 
small that required training must be deferred until en- 
ough trainees are available to justify the cost. A re- 
lated problem faced by many training departments is the 
manner of conducting training for second and third shift 
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personnel. Regardless of the solution^ the trainee is 
seldom satisfied by having to put in paid overtime to 
receive the instruction. 

The third problem is that of training employees 
from a plant who work in widely dispersed locations with” 
in a metropolitan area. Bringing the trainees to a cen<= 
tral location involves considerable expense in transport" 
ation and time away from the job. For a detailed and 
lengthy course there is often no acceptable answer other 
than hiring additional personnel. 

These three problems can be significantly alleviated 
by programmed instruction. Because the new training 
package of educational material makes a self “Sufficient 
package of educational material available to each train= 
ee, it reduces the need for qualified instructors in 
many courses and allows the company to train its employ" 
ees individually and at any time and place. Beyond this 9 
programmed instruction offers the possibility of train™ 
ing employees more quickly and more effectively than 
traditional methods allow. 11 

There's a feeling in programmed instruction circles 
that any teacher who can be replaced by a machine should 
be . 



11 

J L. Hughes and W. J. McNamara 9 "The Potential of 
Programmed Instructions," Personnel . Nov. “Dec . 9 196l 9 p.63. 
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A number of industrial instructors, and even training 

12 

directors, are certainly inadequate enough to qualify. 

Any training director who has the foresight to insure 
that an efficient program is properly used need not fear 
for his Job, for the effectual employment of these tools 
can only enhance his position with his superiors. 

Military training is somewhat different again. The 
expenditure by the Air Force in excess of $100,, 000 for 18 
AutoTutors and programs at Keesler Field is much easier 
to Justify. As is the case in training of military air~ 
men in fundamentals of electronics, most trainees are go~ 
ing through a training cycle with a large group. The 
machines can be effectively utilized during the day and 
the continuous input of personnel in such a program re» 
suits in a low per pupil cost for instruction equipment. 

Training personnel in industry have indicated that 
it is practical to develop programs for those Jobs in 
which you have "conformity learning". Generally speaking 
this breaks down into these five general types s 

1. Rote memorizing (procedures, names, fixed rules) 

2. Job skills (lubrication, filing system, credit 
policies) 

3. Problem solving (training assembly line inspect 
tors, quality control) 

12 

Christian, "Guides to Programmed Learning," on . clt . 
p. 37. 
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4. Mastering concepts or generalizations (algebra, 
slide rule techniques;, PERT) 

5. Pattern recognition (assembly line jobs, 

sorting)13 

To those training situations falling into the above 
categories several advantages accrue. It must be empha~ 
sized that it is not necessary to scrap a good program 
presently in force to gain these benefits. Most of the 
successful industrial training departments have supple~ 
mented, not replaced , a competent program® In this man= 
ner they have been able to measure greater effectiveness , 
a consistency in instruction and dollar efficiency of 
training. For many of the larger corporations these 
accomplishments are combined with a degree of decentral° 
ization of training not previously possible. By bringing 
the training to the trainee when it is needed per diem 

<®ii 

costs often associated with instruction are reduced if 

14 

not eliminated. A variety of indirect benefits have 
been recognized but accurate measurement of many Is not 
possible . 

The outstanding, and probably most successful, pro= 
gram described in the references is the assembly line 
operation which Hughes Aircraft Company has installed. 

^Christian, op . clt . „ p. 110. 

l4 e.g., improved supervision, higher morale, better 
defined training goals. 
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Hughes installed over 1,000 Videosonics in production 
lines in Tuscon, El Segundo and Fullerton. The pilot 
test was run in 1958 in the Tuscon plant on a Falcon 
Missile assembly project. The results of this test were 
a reduction of production defects ranging from six to 
thirteen per chasis at the start of the test to 0.0 6 per 
chasis within a ten month periods, a reduction of 99^. 

The Videosonic combines visual presentation with 
tape instruction. The hardware resembles a portable T7 
set. The visual presentation is on a 35mm. film strip 
and is synchronized with a magnetic tape recording. A 
set of headphones completes the unit and one set is in™ 
stalled at each bench position on the assembly line. In 
this assembly process one operator completes an entire 
assembly rather than doing just one mechanical task. The 
speed of presentation is controlled by the operator and 
she is allowed to take as much time on each sequence as 
she feels necessary. 

The initial program , used when a new chasis or a new 
operator comes on the assembly line, gives detailed pro= 
cedures and includes warnings of possible problem areas 
based upon production defects encountered in the past. 1 ^ 
When the operator is efficient enough to speed up the op= 
eration an abbreviated tape is used. This tape covers 
the operation but does not go into the detail as much as 

^e.g„cold solder joints a solder splash, reversed 
components, insufficient clearance between components, etc . 
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did tape one. It does repeat the warnings that are re= 
quired to keep the product up to standard as concerns 
quality control. The super-short version*, sometimes re- 
ferred to as the "Bikini ", would just hit the major points 
as a brief outline would do for a book review. 

The drastic reduction of defects was only one of the 
benefits that Hughes obtained. Output was increased in 
all cases , as the realization rate between standards and 
production was increased from 60% to 90% and 100^ on a 
consistent basis. Others factors of note weres (1) by 
reducing variables attributed to individual operators g 
production is much more standardized 9 (2) a special qual- 
ify control group that acted as a check and test unit was 
eliminated entirely 9 (3) supervisors*, who previously had 
been devoting almost all of their time to trainings were 
now able to concentrate their efforts on managing person- 
nel, and (4) engineering changes could be introduced in a 
matter of hours rather than days as had been the case pre- 
viously. 

Hughes also determined that the same type of program 
could be designed for operations such as machine shop and 
tube testing. The testing operation required the use of 
a cathode ray oscilloscope for comparing wave shapes with 
those of suspect tubes. Colored slides showing the exact 
wave pattern desired were used to make comparisons with 
the actual tube being tested. The effective testing time 
was reduced from just under five hours to 17 minutes. 
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On one assembly line making a critical inter- 
mediate frequency amplifiers, it previously required 
about four months for an operator to get up to the 
line's average realization of about 53$ of the work 
standard. After Video-Sonics was installed 9 Hughes 
transferred a new operator from the wire harness 
line into the IP amplifier line. By the end of the 
first day she had achieved a rate of 80$ of the work 

standard. 16 

Hughes Aircraft has now entered the teaching machine 

production field because of their success with the Videos 

sonic. The amazing results cited above could be the 

claim of an enterprising sales manager except that they 

were cited in several periodicals in 1960 9 prior to the 

time that the decision was made to enter the teaching 

17 

machine production field. 



16 

Philip J. Klassg "Video-sonics Cuts Production 
Defects" 9 Aviation Week ,, Vol. 72 9 Part I y January 4 9 
I960, p. 77. 

17 

'Klass, op. cito 9 pp. 75»79l and Business Week o 
"How Machines Do Teaching Job 9 " September 17 s I960, 
pp. 111=114. 
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CHAPTER III 



PART I. THE GROUP SURVEYED 

The large amount of information available on program- 
med Instruction in use in industrial operations would lead 
one to believe that it has been widely accepted. In order 
to either prove or disprove this assumption it was neces- 
sary to conduct a survey of industry. 

In trying to determine who should be included in the 
survery, further research was required to find the common 
ground upon which a decision to use programmed instruction 
could be based. The first idea that came to mind was the 
cost of the tools and hardware. When a review of prices 
revealed that teaching machines ranged from $25 to $5 9 000 
and textbooks were available from $3°00 up it was evident 
that this could be, at best 9 only a partial answer. 

A second point was the size of the labor force but 
this did not seem to insure the use of programmed instruc- 
tion either. Meat packing and food processors employ 
large amounts of untrained labor but would not be good 
candidates for programmed instruction purchases® The 
automotive industry has tremendous labor rolls however, 
it was doubtful if they would be required to spend much 
money to bring workers to the level that he could fit 
pieces together, insert bolts in predrilled holes, spot 
weld, tighten nuts, etc® 

The size of the company was another factor to be 
considered. This was tied in again with cost of the pro- 
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gram and there did not seem to be any definite coorelation. 
Nor did the type of business seem to be the key to employ* 
ment of programmed instruction . 

As long as there did not seem to be any one factor 
that could be applied 9 what combination of factors would 
satisfy the requirements? The following elements seemed 
to apply to some degree in most cases 8 although not all 
were applicable or to the same degree in any given in* 
stances 

1. Number of employees to be trained 

2. Repetitive nature of the training 

3. Size of the company — - - ....... 

4. Cost of the program -= including aids and hard* 

ware 

5 . Type of business 

6. Present size of the training function 

7* Management outlook* and 

8. Business success* 

There did not seem to be any way in which it would 
be possible to select* at random* a list of diverse corp* 
orations that would meet the requirements* 

Because of this the annual listing contained in the 
Fortune magazine of the largest corporations * from point 
of sales* seemed to fit most of the necessary elements* 
Even though it did not include small concerns* if seemed 
upon consideration that they probably would not qualify 
on many of the points. Their budgets would not permit 
the large initial expenditure and the number of employees 
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to be trained would be on an almost individual basis after 
completion of the elementary training# 

The Fortune listings of the largest companies based 
upon sales did not necessarily guarantee such things as 
profit s successs forward looking management or adequate 
training. It did insure inclusion ©f diverse industries , 
different size labor forces , companies that ranged from 
individual processing by skilled artisans to large assemb- 
ly line operations a both white collar and blue collar train- 
ing, and seasonal operations employing considerable itin- 
erant and manual laborers# 

The questionnaire'*’ was sent to the Director for Train- 
ing of the following concerns doing business in the United 
Statess 

1. 500 largest industrial corporations 

2. 50 largest commercial banks 

3# 50 largest life insurance companies 

4. 50 largest utilities 

5. 50 largest retail merchandising firms, and 

6. 37 selected large companies# 

The answers received revealed that many of the large 
utilities were, in fact, holding companies# In many in- 
stances the questionnaire was forwarded to the largest of 
the utilities within the company for an answer# 

The 37 selected concerns reported in item 6 above 
were airlines, railroads, bus operators and over-the-road 
truckers also reported in the August 1963 issue of Fortune# 

^See Appendix A. 
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Some large companies do not release figures in regard to 

their business and therefore 9 they could not be ranked by 

Fortune * I included any large concern in this category 

2 

that I knew from past experience was not on the list. 



2 



e «go 9 



Cargill , Inc. of Minneapolis 9 Minnesota. 



PART II-THE QUESTIONNAIRE 

My primary purpose in sending out the questionnaire 
was to determine the extent to which programmed instruc= 
tion was being used and what forms of aid were employed. 

I did not attempt to determine the cost of programmed 
instruction for I felt that this factor might make many 
concerns hesitant about revealing any information. 

Each firm was given the opportunity to reveal its 
corporate identity only if it so desired. Many companies 
did reveal their identity but asked not to be quoted by 
name in the study. 131 companies returned questionnaires 
which did not list the company but their receipt contrib” 
uted lmmeasureably to the results of the survey® Most 
of the companies in this 131 did not use or evidence any 
interest in programmed instruction® 

The firms and organizations listed in Section D of 
the bibliography all submitted additional information 
with their completed questionnaires® This type of assist^ 
ance was appreciated and contributed to the development 
of the subject. Several individuals volunteered to assist 
in the research for my paper if they should be needed® 

The answers received in the survey far exceeded ex°= 
pectations® Based upon past experience it was felt a 
return of 15 to 20 percent was very good® If the returns 
were between 10 and 20 percent , figures could be develop^ 
ed statistically to make predictions for the study® 737 
questionnaire were sent out and 504 returnsj, or 68 plus 
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percent;, were returned in a two and one~half month period. 
One company wrote a two page letter explaining why they 
could not answer the questionnaire and another company 
made any answers contingent upon receiving a copy of the 
research paper. 

47 Companies requested a copy of the paper when it 
was completed. This group included companies which s 

1. Had programs installed and desired the informa- 

tion for improvement of their own programs , 

2. Had a definite interest but had not installed a 

program as yets, and 

3. Did not have the program and it was necessary 

for the training director to do a selling job 

with management. 

An attempt was made to obtain a company evaluation 

of their programs in respect to? (1) training effective- 
ness, (2) dollar effectiveness, and (3) method in which 
it was used. 

Realizing that the questionnaire could not elicit 
all the information which might be useful, the last por- 
tion was available for comments, either pro or con, which 
would contribute to the research paper. 
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QUESTION 


YES 


NO 


— 

OTHER REMARKS 


Can answers to survey be 
quoted? 


246 


97 


161 not marked 


Has Feasibility study 
been conducted? 


139 


20 


345 not marked 


What method of PI used? 






88 teaching machine 
193 programmed text 
25 scrambled text 
9 other 


How is PI used? 






217 supplement 
lectures 
74 alone 


Has PI permitted reduc~ 
tlon In training person^ 

nel? 


26 


104 


59 reduction 


Does trainee proceed on 
own? 


126 


21 




Is training compulsory? 


108 


85 




Is training conducted 
during working hours. 


68 


48 





Figure 1. Survey Answers 
(See Appendix D) 

PART III - APPRAISAL OF THE RETURNED QUESTIONNAIRE 



In order to properly examine all facets of the question 
in line with the statement of purpose $ each subject in the 
survey will be considered separately® The questionnaire in 
Appendix D from which figure 1 was taken P has been filled in 
with the quantitative answer received in the survery® 

Of the 504 returned inquiries s 49 percent or 246 gran= 
ted permission to quote any information they gave® 161 

3 

cf. ante p. 5 
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were not marked and in those cases it was assumed that 

they did not desire to be quoted by company name. Of the 

97 negative answers 22 identified their company and gave 

their name and title in question 2. 

Question 3 was poorly worded for it was assumed that 

a study would have been conducted in all cases before pro- 

grammed instruction was introduced . Several training dir- 

ectors indicated that this was not true for their decision 

to use programmed instruction was based upon information 

4 

received from other sources. As others pointed out* the 
results of the studies were not always in favor of the in- 
troduction of such a program. 24 firms indicated they were 
awaiting results of a study conducted by their own train- 
ing departments by an outside organization surveying their 

company* or information furnished by a professional organ- 
5 

ization. There were 139 companies which declared they 
had conducted studies as to the feasibility of installing 
programmed instruction and 20 disclosed they had not con- 
ducted their own survey prior to the use of this type of 
training aid. 

4 

e.g. Many life Insurance companies indicated the 
decision to use programmed instruction for sales training 
and product knowledge was the result of the evaluation of 
previous studies conducted by the Life Insurance Agency 
Management Association. 

5 

See Appendix C* Chart II 9 Line 3. 
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18.4 percent, 7 out of 50, of the Life Insurance Com- 
panies were awaiting results of a study. This information 
was given in an address at the Life Insurance Agency Manage- 
ment Association annual meeting in Chicago * Illinois the 
week of November 11“15» 1963® In his address Dr® Wallace^ 
Vice President -- Research;, of LXAMA saids 

LIAM A did show that agents who have more knowledge 
(of life insurance) tend to have a higher persistency 
of business than those with less® 

It seems apparent that what is needed here is some 
method by which we could Improve the general knowledge 
level of our agents and 9 at the same time p free our man- 
agers from an activity which they do not like or are not 
particularly well suited for and give them more time to 
do the sales training which is p or should be 9 their 
major Interest and responsibility® 

How to accomplish the release of managerial time 
without lowering our knowledge level? For some years 9 
your research staff at LIAMA has been concerned with 
this problem® We have been closely following the work 
which has been progressing on what are called self=ln= 
structional techniques® There are many varieties of 
such techniques and some considerable differences in 
the theoretical structure upon which they are based® 

Thus far 9 most of the investigations of self-in- 
structional methods have been made in the school (gram- 
mars, highs, and college) or the armed forces setting® 
Generally j, it has been found that for basic school sub- 
jects and for such knowledge areas as electronics.., 
weapon systems^ etc® 9 the self-instructional approach 
can make dramatic improvements in the knowledge level 
reached and in the time required to reach it® In facts, 
in the educational world there is some worry that the 
technique will replace the teacher too thor©ughly--a 
concern which;, fortunately 9 we need not share® 

This evidence was strong enough to encourage us 
to investigate what this technique might do for our 
Industry and s because most of the successful applica- 
tions have been in the field of knowledge and because 
our problem in the area of basic life insurance know- 
ledge I mentioned earlier^ we decided to see what could 
be done there. 

We have invested a very considerable sum of money p 
LIAMA staff time 9 and time of agents 9 managers;, and 
home office staff of some wonderfully cooperative com- 
panies in a research project to evaluate the self-in- 
structional technique in life insurance setting.- 5 



C 

3 S. Rains Wallace , "Steps Into Life Insurance®" 
Presentation made before the Life Ins. Agency Management 
Association at the 46th annual meeting® November I4 y 1963® 
P. 4 9 6-7® 
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Dr* Wallace went on to tell how thoroughly they had 
developed the course and recommended its use for the im* 
provement of salesmen” s knowledge*, an increase in sales and 
a freeing of the agency sales manager for other duties. 

If the decision of the seven insurance companies re* 
ferred to above hinged upon the recommendation or lack of 
recommendation by LIAMA 9 it would seem that they will con* 
sider introduction of programmed instruction in their train* 
ing 8 

Question 4 (a) requested information on whether teach* 

ing machines were used and if s© 9 who were the manufactur* 

ers and what were the models o 38 respondents indicated 

6 

they were using some form of teaching machine There 
were 19 different models listed that could be identified 
as to type and manufacturer » They varied from the moder* 
ately priced machines using printed media and requiring a 
written response to complex digital computer programmed 
and computer controlled psychomotor devices o The number 
of machines which each company had was not requested and 
eight of the companies failed to identify the model or 
manufacturer of their machine s. 

A percentage of 48 » 6 ©f the companies using program* 
med instruction used some form of teaching machines » The 
comments concerning the advisability of teaching machines in 
a training program varied considerably 0 Mr« Harold Z» Mason*, 
Manager Station Training g Trans World Airlines? 

°See Appendix E° 
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Teaching machines == absolutely not"® While we 
do not have starts in our eyes*, we are excited about 
programmed instruction® We are totally disinterested 
in teaching machines at this stage of development of 
same® We can*, however*, teach more in less time with 
PI® PI will never completely replaces 

1. A teacher or instructor 

2. Student demonstration of skills*, and 

3 • Need for student contact with a specialist® 

On the other hand a Corporate Director*, Manager De° 

7 

velopment and Training of an industrial firm reports g 

We have 32 teaching machines of 11 different 
types for use in our five divisions® Each serves a 
special purpose and is an extremely valuable addition 
to our training facilities® In addition*, we use pr©“ 
grammed and scrambled textbooks® We have not replac° 
ed any training personnel by using any of these aids 
but we have doubled the efficiency of our teaching 
and are able to adequately handle many more employees® 

Mr. Robert E. Goche*, Vice President *, Greyhound Corp° 

oration expresses his opinion of teaching machines in this 

statements 



Western Greyhound Lines*, a division of Greyhound 
Corporation headquartered in San Francisco *, is the 
first of our divisions to utilize teaching machines® 
Their acceptance of the Edex response teaching machine 
is excellent and the results have been extremely grat~ 
ifying. 

As can be seen from the above quotations there is a 
great difference of opinion concerning the value of teach- 
ing machines even among advocates of programmed instruction® 



7 

'The Training Director quoted requested that he and 
his company not be identified by name other than the fact 
it was an industrial concern® 
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Question 4 (b) dealt with programmed textbooks® The 
programmed textbook resembles a regular school text in that 
the material is presented in logical steps and does not re» 
quire the student to skip from page to page® The method of 
communications, however 9 does differ from the ordinary text~ 
book. The material is presented in short paragraphs and 
the trainee is tested upon the completion of each small 
unit before going on to another point In the program® In 
other words 9 the book becomes the hardware similar to the 

Q 

teaching machine® The survey indicated 193 programmed 
textbooks were being used® 46 companies denoted they had 
developed one or more of the texts which they were using 

Q 

and 125 were purchased from publishing concerns * Appendix 

P lists 26 concerns cited as publishers of the textbooks 

being used® In addition to those publishers;, ’’Teaching 

10 

Machines and Programmed Learning” list several additional 
companies supplying programmed texts® 

Texts for all courses are not available on the ©pen 
market 9 108 corporations employed consulting firms that 
developed courses especially for their use® The 712 courses 
reported in the survey* both in~house and commercially pre= 
pared* have been listed in Appendix G® As can be seen 
some would have limited application while others could be 
employed by almost any concern requiring instruction in the 

Q 

cf® ante. * p. 8. 

g 

See Appendix E and F. 

^U. S. Department of Healths, Education & Welfare* Teach=> 
ing Machines & Programmed Learning., Office of Education. 1962® 
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topic. Many of the programs that are de% 7 eloped by consult" 
ants are modifications of a general e.ourse designed to the 
specific requirements of the firm. Indications are that 
this type of change is relatively inexpensive while the 
complete development of a program will require a consider" 
able expenditure of time and manpower. 

Professional and trade organizations , such as the 
American Management Association and the American Institute 
of Banking, have entered the programming field also as an 
aid to members. This is possible with courses such as 
"PERT" and "Cost Reduction and Control for Supervisors" 
which would have general application in most industries. 
Manufacturer developed programs, similar to the Interna- 
tional Business Machine Corporation" s computer courses, are 
for use with a particular product regardless of the Ind- 
ustry employing the training aid. 

The acceptance of scrambled textbooks has not been up 
to that of the regular programmed texts* Only 25 scrambled 
textbooks were indicated as being used. 6 were developed 
by corporation training divisions, 8 were purchased from 
outside consultants and 14 commercially published programs 
were used. Inasmuch as this totals 28 and only 25 texts 
were reported as being used, I assume that some texts were 
developed by training departments in conjunction with out- 
side consultants. 

The cost of scrambled texts considerably exceeds that 
of the regular programmed textbook. One text covering a 
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complex operation is quoted at $152. Perhaps this accounts 
for the fact that commercial publishing concerns have not 
rushed into this type of printing. The scrambled text is 
a modification of the Crowder theory.^ I believe the re- 
latively small usage is a reflection of the increased pur- 
chase cost and not cn the value of the text as a method of 
instruction. 

The 9 types of programmed instruction reported under 
question 4 (d) were taped instruction. These were not de- 
scribed in detail so it is not known just what form these 
take. If it is just the use of a tape recorder to supple- 
ment a classroom lecturer, it is doubtful if this could 
properly be considered programmed instruction. 

The answers to question 5 are reported in Appendix G. 

In order to eliminate the listing of many similar titles, 
courses have, in some cases, been grouped under a general 
heading. 

In answer to question 6, which asked how the program- 
med instruction was used, 217 companies indicated the pro- 
grams were supplementing classroom lectures and 74 employed 
the programs as the sole instruction aid. As only 181 com- 
panies indicated the use of programmed instruction, the re- 

Ip 

plies have to be related to the 306 instruction instruments. 
Using this base, 71 percent are using the programmed instruc- 
tion as a supplement and 24 percent use it as the sole 

11 

scrambled textbooks, cf. ante., p. 18. 

12 

88 teaching machines, 193 textbooks and 25 scrambled 
textbooks. 
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nod instruction as a supplement and 24 percent use it as 
the sole training device « There were many comments to the 
effect that programmed instruction should not be the only 
method employed and others that indicated certain courses 
would not require any additional assistance: 

1* L. R. Lenar z, Manager, Production & Industrial 
Engineering, The Magna vox Company -- Courses in 
"electronic wire and solder training" and "in- 
spection training" must be supplemented with 
lectures but "employee indoctrination" and "man- 
ufacturing processes" are complete unto themselves 

2. H. Oo Holt, Director of Training Research, Ameri- 
can Telephone and Telegraph Company — "Basic 
electricity" is a self-contained package although 
some operating units are adding lab exercises; 

WATS and 20-40 DIALP AK (sales training) are self- 
contained. 

3. K. R. Berkheimer, Supervisor, Electronics Train- 
ing, Lockheed-California Company -- Our courses 
are for background training and skills upgrading 
(Calculus, Sets, Introduction to Electronics, 
Trigonometry, etc.) are used independently at 
present. A variety of approaches will eventually 
be used on courses that are to be added to our 
training program. 

4. Thomas P. Higgins, Assistant Training Director, 
John Hancock Mutual Life Insurance Company -- 
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Some of our courses teach a cross section of employees 
with limited insurance knowledge the knowledge of the 
fundamentals of life insurance. Others are used for 
teaching computer programmers the basic principles of 
the IBK 1401 programming and staff personnel the PERT 
technique. They are used as the sole teaching instru- 
ment, except computer programmers also received formal 
classroom instruction in programming electronic data 
processing equipment. 

Prom this and other similar statements, I think it can 
be safely said that whether a particular program is used as 
the sole method of instruction or is supplemented by some 
form of personal instruction will depend upon the subject 
and the group being taught. 

In answer to the question regarding a possible reduction 
of training personnel 26 companies, 14 percent, indicated 
they had been able to reduce a total of 59 personnel as a 
result of the introduction of programmed instruction. 104 
or 57 percent indicated that there was no reduction in per- 
sonnel. However, many qualified their answer in the follow- 
ing manner : 

1. Robert E. Britton, Director, Sales Training, The 
3even-up Company, St. Louis — No, not the intent 
of the program as nothing has been replaced. Pro- 
grammed material has been added to, and integrated 
into, present training programs with no additional 
personnel required. 



42 



2. Selwyn Brent, Education Consultant, UN I VAC (Div. 
of Sperry Rand Corn.) -- Lane d lately no, but long 
range training staff reduction is more important . 

Syst GK1S Analysts double as instructors and this al- 
lows them to concentrate on Systems Analysis. 

3. Robert Brin 1 :, Instructional Programs Supervisor, 
General Telephone Co., of California — No, but 
time saved is applied to other supervising require- 
ments . 

4. Harry G. Noodward Jr., Manager, Training Services, 
Interstate Bakeries Corporation — No, but more 
training is done and there is no increase in the 
training staff. 

It would seem from these remarks that the total train- 
ing dollars probably will not decrease but the value re- 
ceived for the training dollar will be larger than had been 
the experience prior to the introduction of programmed in- 
struction. If a larger group may be trained the cost per 
trainee could be reduced. 

Question eight had to do with the method of instruction, 
specifically, was the student allowed to proceed at his own 
pace. The overwhelming answer to this question was Yes. 

126 or 70 percent were allowed to pace themselves and 11 
percent, 21, were kept to a class pace. There wan no indi- 
cation given as to what courses were included in the 21 neg- 
ative answers. 
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As question nine consisted of four parts requiring a 

sf 

t 

narrative answer, rather than one which could be answered 
by Yes or No and be quantified. Some of the most signifi- 
c an t replies we re : 

1. Jan you cite results of effectiveness or lack 
of effectiveness of programmed instruction, vs. 
lecture training? 

a. Ralph vJA v/alker, Supervisor, Programmed 
Instruction Unit, Martin Co. (Denver) — 

YDS, our programmed instruction Titan II 
Familiarization course yielded a 9 • 3/ in- 
crease as measured by the same criterion 
te st . 

b. J. J. Stadtherr, Training Director, The 
Pure Oil Co. -- Definitely mere interest 
shown in self development at all levels. 

c . J. Howell Staley, Assistant Vice President, 
The Philadelphia National Bank — Our em- 
ployees have reacted enthusiastically to 
programmed instruction, and studies made 

by our Loan Department reveal much better- 
retention by those who have taken the P.I. 
course. 

2. Jan you cite any results of savings or lack of 
savings in training hours and/or dollars? 

a. P, L. Docker. , Training Director, The Maytag 
Co., -- we have definitely proven that P.I. 
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will save training hours on wire harness 
training by operating people. 

b. Robert R. Royce, Training Consultant, 

Atlantic Refining Company — Saves a few 
minutes of supervisor’s time, but what is 
more important, insures trainees get taught 
simple tasks that the supervisor is apt to 
forget. 

c. C. If. Flanders. Corporation Manager Train- 
ing, Sprague Electric Co. -- Isolated train- 
ing problems have been solved and spot train- 
ing may be done easier and faster. 

d. Ralph Vf . walker , Supervisor Programmed In- 
struction Unit, Martin Co. (Denver) — Yes, 
the Titan II Familiarization course yielded 
a 30 % student savings when administered to 
site and field personnel. Also a 3 ^% re- 
duction in students time. 

3. Can you cite results of training cost per stu- 
dent or course of instruction with programmed 
aids vs other forms of training? 
a. George L. Germain, Supervisor - Development 
£ Training, Lukens Steel Company -- About 
13 hours of training time per student saved 
versus a relatively inexpensive course cost 
per student (AM A' s Cost Reduction and Con- 
trol for the Supervisor) because they do the 
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program on a voluntary basis on their own 
time. It holds their interest and makes 
"homework" more challenging. 

b. Sverett L. Smith, Coordinator of Training, 
Sunray DX Oil Co., — There is a much small- 
er cost involved on the amount of programmed 
instruction being used at this date. 

c. Norman R. Miller, Training Supervisor, 
Westinghouse air Brake Co. — If off the 
shelf programs can be ussd, there is a tre- 
mendous savings in course development time 
for classroom instruction. 

d. Bennett Dolan, Training Systems Manager, 
Security First National Bank of Los Angeles 
— Permits high quality training in outlying 
branches; not economically possible any 
other way. 

4. Can you cite any results of employee attitude 

of lecture type training as contrasted to pro- 
grammed instruction? 

a. Walter E. Gaipa, Associate Director of Field 
Training, Field Training Div. — District 
Agencies Dept., Prudential Insurance Co.-- 
Trainees overwhelmingly prefer P.I. 

b. James H. Kearney, Training Assistant, The 
Mead Corporation — Trainees desired more 
of this type of training plus wanting more 
advanced courses. 
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. John H. Stetson, Director of training, First 
National Bank of Bos ton- -Prom the instruc- 
tor's standpoint there is a noticeable dif- 
ference in the understanding of the group to 
the subvert matter presented --because the 
trainees have the background, through the 
Programmed Instruction, to follow more easi- 
ly the application to their situation, 

d. R. N. Rolf e , Ohief, Education and Training, 
Northrup Norair — Early questionnaires in- 
dicated 25 % preferred lecture, 25 % had no 
preference, and 50 % preferred programmed in- 
struction. Findings at this time indicate 
that programmed instruction will offer more 
complete subject mastery and greater class 
flexibility at lower cost. 

e. Dale R. McCracken, Industrial Engineer, 
Champion Spark Plug Co. — Programmed train- 
ing is accepted much more readily by employ- 
ees. 

The following answers were received to question ten re- 
garding the manner of conduction the programmed instruction: 
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1 , 

2 . 

3« 

4. 

5. 

6 . 

7. 

8 . 

9. 



Compulsory 

Voluntary 

If voluntary, approximate 
% of participation 

On a continuing basis 

Upon initial employment 

Whenever an employee is 
introduced to a new func- 
tion or process 

At regularly scheduled 
periods. 

During non-working hours 
During working hours 



Number Percen t 

108 59.o 

85 47. O 13 

13 cited percentages 
ranging from 10% to 
98$. Avg. , 61$. 

61 33.7 

52 23.7 

41 22.8 

47 25.9 

48 26.5 

21 16. I 14 



In the quotations I have given from the returned que- 
stionnaires, I have, of course, presented a biased picture 
taken from the 36 percent who have advised that they are 
using programmed instruction. I endeavored to select those 
answers which answered the question best and avoided, wher- 
ever possible, more than one quotation from the same source. 
It was hoped that this last factor would better indicate the 
acceptance of programmed instruction and at the same time 
point out some limitations. 

Question eleven requested additional comments, either 
pro or con, which would contribute to the research project. 



lg 

^Overlap in the above instances is due to multiple cours- 
es being offered within a company of either category.' Had the 
question been answered by all 181 corporations the overlap 
would have been considerably larger. 

14 

This question was not specifically asked but 21 indi- 
cated that instruction was conducted during working hours. My 
guess would be that the answer to the question would have been 
approximately 75+ percent indicating an overlap again. 
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Inasmuch, as many of the best comments are also from the 
persons who have been previously quoted, it will be nec- 
essary to repeat some of the sources in order to present 
a complete picture: 

1. Philip P. Miller, Assistant Vice President, Dir- 
ector of Training, Crocker-0 itizens National Bank. 

--Under programmed instruction there is a renewed 
interest in training that is not evident under 
lecture type training. 

2. Dean D. Osborne, Supervisor of Development and 
Training Supervisor, E. If. Bliss Company — We 
could write programmed instruction but time is 
of the essence. Like color TV, texts will be 
forthcoming at a reasonable figure. Our company 
developed a program over a year and one half per- 
iod and now a text is available on the market. 

3. Clarence W. Glud, General Training Supervisor, 
Rayonier Incorporated. — Seems to be of most 
value for individual instruction when the size 
of the class would not justify the expense of an 
instructor. Some students are able to fit their 
studies into slack periods during working hours 
rather than be taken away from the job when ur- 
gent work assignments are pending. 

4. Jack D. Robb, Manager of Training, McDonnell Air- 
craft Co. -- I feel the programmed text is good 
but must be supplemented with film, discussion 



periods, lab (where applicable) and tests to deter- 
mine gic li i element. It is erroneous to believe the 

text, in most cases, by itself distributed to a 

\ 

group will be effective. 

5. Gordon M. Rhodes, Assistant Cashier, Personnel - 
Operations, First National City Bank of New York 
City — le are completely satisfied with efforts in 
Programmed Instruction over the past three and one 
half years. We no longer utilize outside consult- 
ant companies but instead have an internal program- 
ming section consisting of three programmers and one 
clerk with the intent of further utilization of pro- 
grammed instruction as an adjunct to our convention- 
al training methods. In all areas of utilization, 
students achieve completion of the course material 
in shorter periods of time and attain maximum train- 
ee output in approximately 50$ of the time it form- 
erly took. 

6. R. E. Silver, Training Director, Micro Switch Div., 
Honeywell Corporation -- To date, we have mainly 
used programs of general nature in basic areas 
(slide Rule, Calculus, Memo Writing, PERT). One 
man has been prepared to write programmed material. 
As of now he has one short program on solder train- 
ing completed. We feel that well done programs 
properly applied will pay real dividends to any 
company working in the training area. We still are 
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of the opinion that tailored or modified programs 
are too costly for most small sized training jobs. 

7. George L. Germain, Supervisor - Development & Train- 
ing, Lukens Steel Company — The way a program is 
used is as important as the program itself. No 
training, programmed or otherwise, will be very 
successful without active interest of management 
and proper, continuing follow-up . 

8. James M. Yasinow, Training and Development Advisor, 
Cleveland Electric Illuminating Company — I be- 
lieve programmed instruction has its place, but it 
is only one tool of many available to trainers. Al- 
though some trainers are flocking to programmed 
material as though it were a panacea, I do not share 
their unbounded enthusiasm. We use programmed ma- 
terials quite selectively. Much of the programmed 
material available today I consider to be overpriced. 
Much of it is of real value, in terms of reduced 
training time and effective results. If it meets a 
need, then programmed learning can do a job. Mater- 
ial which doesn't meet your need is worthless. 

9. Ralph E. Giles, Assistant Director - Personnel Dev- 
elopment Division, Continental Oil Company — The 
refinery operator is a shift worker, because of a 
degree of automation, the operator's presence is re- 
quired but he is not busy all of the time -- only 
when the unit is upset, or starting up, or coming 
down. 
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When an operator is pulled off the job for class- 
room instruction, he must be replaced by holding ov- 
er the operator of the prior shift for half of the 
vacant shift, and calling out early the operator 
from the following shift for the other half of the 
vacant shift. 

This means overtime! Manhours in classroom cost 
time and a half! Programmed instruction permits 
technical upgrading of operators on the job without 
Interference with normal duties at no cost beyond 
the materials. 

Programmed instruction has not only reduced time 
and dollar cost of old training, but permitted new 
training that was formerly prohibitive in cost. 

10. Ralph E. Boynton, Vice President, Training Depart- 
ment, Bank of America — The accelerating require- 
ments for employee development programs have been 
generated primarily by organizational growth and 
technological change. Meeting these requirements 
demands that traditional instructional methods re- 
ceive substantial subsidization from media which (1) 
utilize the proven principles of programmed instruc- 
tion, and (2) incorporate the inherent advantages 
of audio visual applications. 

The Bank of America is presently investigating the 
feasibility of extending the application of these 
techniques to a variety of other areas, including 
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teller training , proof machine operation, and inter- 
national banking. It is emphasized that programmed 
instruction, teaching machines, et al, are regarded 
as a means for more adequately supporting, not re- 
placing, instructional supervision. 

11. P. M. Nadolny, Supervisor, Training and Accident 
Prevention, Duquesne Light Company -- ¥e started 
programmed instruction in subjects where best ap- 
plicable. This type instruction ensures that all 
the details are covered, however, we often supple- 
ment with lectures to clarify certain points. Re 
have found programmed instruction very effective 
for our type training and plan to develop addition- 
al courses. 

I have cited in Part III, 38 executives who are directly 
concerned with training. In order for them to have made the 
statements I have quoted, it was necessary for them to have 
evaluated the companies" training requirements and goals, the 
available methods and the cost and effectiveness of the methods. 
18 different industries are represented in this group to give 
as large a cross section as possible. 

712 courses have been programmed by or for 181 commercial 
enterprises. If these successful firms feel that the dollars 
expended for training contribute to profit, it can be assumed 
that there is a value to be gained from using programmed in- 
struction. 

The Training and Education staff of the Industrial Rela- 
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tions Department of the Head Corporation conducted a survey 
in early 1963 similar to this one . They sent 133 question- 
naires to randomly selected companies in several industries. 
Of the 71 replies received , 29 or 41$ reported the use of 
programmed materials. This is just a bit more than the per- 
centage (39$) that answered affirmatively in this study. 

There were differences in some of the details but the coore- 

V~> 

lation between the two independent studies was remarkable ' 
.1 similar study made in mid-1962 by Gordon L. Lippi tt 
and Jayne N. Sehelle and. reported in the Journal of the 
American Society of Training Directors in November 1962, re- 
vealed that only 20 percent of the members of the Society 

were using programmed instruction selectively or only occa- 
16 

sionally. It is not known how many of the organizations 
contacted in this study are members of the American Society 
of Training Directors. It would not be unreasonable to as- 
sume that most of the companies would have been included in 
my list of 737 corporations. 



13 

Rex P. Sheets, Dorn Ramirez and James H. Kearney. 
"Programmed Instruction." Notes from a panel discussion 
presented to the Annual Conference of the American. Society 
of Training Directors, May 6, 1963. 

16 

David 3. Story. "Programmed Instruction and Its 
Importance for the Training Section." Industrial Relations 
Training Section Bulletin of the Boeing Corporation, June 
196y# op. 9° 



I feel that this is an indication that the number of 
firms realizing the value of this media has increased and 
will continue to do so in the future. 

The factors limiting the use of programmed instruction 

17 

in the Lippitt and Schelle study were; 

1. High initial cost 

2. Small population to train 

3» Low turnover 

4. Not suited to work involving judgmental complex- 
ities 

5. Programs not available which are needed or easily 
adapted 

6. Rapid obsolescence causing rewriting of programs 

7* Difficulties in programming 

8. No existing need 

9. Lack of interest 

Some of these reasons were cited in the negative re- 
turns received in this research questionnaire, however, the 
reason for not using programmed instruction was not directly 
requested. The 34 returns, which indicated a study had been 
conducted and the results disclosed that the introduction of 
programmed instruction would not be practical, gave as a 
reason a variation of 1 through 9 above. 

Further information received in Society of Training 
Directors survey concerned the attitudes towards program- 
med instruction and the advantages and disadvantages 

17 

David B. Story. "Programmed Instruction and Its 
Importance for the Training Section." Industrial Rela- 
tions Training Section Bulletin of the Boeing Oorp. v 
June 1963. pp« 10. 
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attributed to automated teaching. The summary of these were 
18 

as follows § 

ADVANTAGES OP AUTOMATED 
TEACHING 



Advantages 




Responses 


of 

A 


Standardized instruction . 


» • « 


78 


27 


Paster learning . . 






63 


23 


Increased retention 






42 


14 


Increased learning 






42 


14 


Cost reduction . • . 






25 


9 


All of these .... 






51 


11 


None of these . . . 






6 


2 


TOljrclX 0 • e 


o • • 


• 00 


292 


100 


LIMITATIONS AND 


DISADVANTAGES 




Disadvantages 




Responses 


% 


Difficult to program 


the mat'rl 


105 


33 


Impersonal & loss of 


human 


element 93 


35 


Higher Cost 






51 


18 


Lack of student interest . 


• • 0 


13 


5 


None of these . . . . 






6 


2 


Length of training . 






4 


1 


All of these . . . . 






3 


1 


Total . . . . 






280 


100 



The necessity for adequate programming of material 

19 

was stressed in the earlier part of this paper. As 
to whether or not this should be listed as a disadvant- 
age is questionable. 

18 Ibid . 9 pp. 13° 

19 cfc ante. , p. 10 
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Because a task associated with training methods is difficult 
to perform or unfamiliar* it should not necessarily be a cri- 
teria in determining the value of the media. It is the end 
product which must determine the advisability of implementa- 
tion. These same disadvantages listed above appeared in my 
study. In my opinion the advantages* in both studies, defin- 
itely outweigh the disadvantages. Therefore* I feel that the 
results of the two studies cited above further substantiate 

the results obtained from the questionnaire sent out in con- 

20 

nection with this research paper. 
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See 



Appendix 
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CHAPTER IV 



NAVY EXPIRING E WITH PROGRAMMED INSTRUCTION 
The use of piogrammed instruction could have potentially 
important sugnificance in military training. Military train* 
ers are faced with a short span of training time as well as 
a heterogenous group of trainees. It is doubtful, however, 
if the trainees would he decidedly different thatn would he 
experienced by a large corporation at one of the plants em- 
ploying in excess of 5»000 people. The selection process for 
technical schooling in the Navy is supposed to he based upon 
a psychological evaluation of such things as the General Class 
iflcation Test and other aptitude tests that are given. Sup- 
posedly a person with just above borderline intelligence 
would not be selected for a technical shcool requiring consi- 
derable mathematical skill. On this assumption, it may be 
conculded that the bulk of the technical trainees have the in- 
tellectual ability necessary to attain some measure of success 
The United States Navy has made several evaluations of 
teaching machines and programmed textbooks. The first use of 
a teaching machine occured during World War II. A "pinball" 
type machine was used for teaching aircraft recognition and 
rules of the road in an effort to accelerate instruction. The 
student was given a multiple choice question on a punched 
plastic card and was to press a button corresponding to his 
selection. A correct answer received a green light allowing 
the student to go on to the next question and. at the same 
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time registering a numerical score which took into considera- 
tion response time® An incorrect score meant a red light and 
the student was to make another choice. The effectiveness oi 
the machines was never scientifically proven and due to cost 
and maintenance problems the machines were not utilized fol- 
lowing World War II. 

The work being done by Skinner and other educational 
psychologists in the late 1940 's and early 1950 “s renewed in- 
terest in the teaching machine as an instruction aid. The 
U. S. Naval Training Devices Center has undertaken several 
studies as well as contracting with civilian institutions for 
research in the field. 

An early project by the NTDC was the design and field 
testing of the "Green Light Rater" in 1958. Basic consider- 
ations of the device are practicality and psychological val- 
idity. The Green Light Rater is inexpensive * adaptable to 
physical environment of trainees* requires minimal mainten- 
ance* and has the advantage of allowing the using activity to 
prepare and install its own questions. Trainees are presented 
with an array of forty two (six rows* seven columns) of 3" x 
5" cards. Each card has a multiple choice question with four 
alternative answers and a row of correspondingly numbered 
buttons below the card. Buttons glow red if Incorrectly pre- 
ssed and green if correct. Its psychological validity is 
based on incentive motivations* knowledge of results* repeti- 
tion* contiguity* distribution* incidental learning* and lack 
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of stress . As to its value as a method of presenting mater- 

ial for review 9 it is more of a "gimmick” than a training 
1 

aid or deviceo 

toother test was conducted by the Guided Missiles School 9 
Dam Neckg, Virginia in an effort to determine if the attrition 
rate at the school could be reduced* Six of the toto Tutor 
Mark II Machines (projected media/key response) were made a- 
vailable for the use of the students for remedial and refresh- 
er training in algebra* trigonometry* electricity and the use 
of the oscilloscope. The machines were used for a one week 
period employing off the shelf programs rather than Navy de- 
veloped and oriented material. The value of the machines was 
not conclusively proven. It was surmised that there was some 
benefit but no attempt was made to document and statistically 
support that supposition. 

The British Navy did conduct controlled evaluations of 
the toto Tutor and Tutor Texts for Naval instruction in trig- 
onometry to compare automated and human instruction. Three 
groups* one using the toto Tutor* one using Tutor Texts (a 
scrambled textbook) and one receiving conventional classroom 
lectures * were given a six lesson syllabus to be completed in 
a nine hour period of Instruction. The groups were pre-select 
ed on the basis of prior educations, mathematical ability as 
determined by testings, age* and intelligence quotient. 

Both groups using the programmed instruction completed 
their six lessons in less than the nine hours allotted (a 
mean of 5*6 hours for the Auto Tutor and 5.5 for the Tutor 

1 

Galing, S. C. "Teaching Machines for Navy Use." A 
research paper submitted to the U« 3. Naval Postgraduate 
Schools, Oct. 1962. 
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Text) while the classroom instruction group was able to fin- 
ish five lessons in the nine hours. Examinations at the comp- 
letion of the course showed grades slightly higher for the 
Auto Tutor group but it could not be called significant. A 
reexamination designed to measure retention conclusively 
proved that the retention rate of either of the programmed 
instruction groups was substantially superior to the class- 
room group. 

Based upon the controlled factors and method in which 
the test was conducted, it should be safe to assume that the 
test did Indicate an advantage in length of learning time 
and retention of programmed instruction over human instruc- 
tion. A questionnaire given the three groups did reveal that 
the programmed trainees felt they preferred the conventional 
teaching methods. This was especially true in the case of 
the group using Tutor Texts. 

An experiment similar to this was conducted at the U. S» 
Naval Service Schools Command, Great Lakes, Illinois by a 
research psychologist from NDTC using Min/Max machines, a 
printed media written response type machine. Courses for 
AD electricity, DC electricity, refresher mathematics and 

calculus were evaluated under the following conditions ; 

1. A comparison of programmed instruction and closed 
circuit television. (As an aside the Dept of 
Health, Education, & Welfare considers closed cir- 
cuit television can be classed as a form of pro- 
grammed instruction. )2 

2. Programmed learning as compared to human instruction. 

O 

U. S. Dept, of Health, Education, and Welfare. Teach- 
ing; Machines and Programmed Learning . Washington D.C.s Ofc 
of Education, U. S. Dept, of Health, Education, and Welfare, 
19621 p. 49. 
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3. Effectiveness of assignments outside class using 
programmed texts and conventional texts « 

It was generally concluded that the results obtained in 
this experiment were similar to those obtained by the 
British Navy® The effectiveness of instruction as measured 
by retention was relatively the same when comparing program- 
med instruction to what are considered convential methods of 
instruction o In the area of Instruction time it was quite 
evident that time savings were possible using the programmed 
instruction type methods and materials « The group using the 
programmed texts gained a significantly increased grasp of 
the material in the assignments outside the classroom envir- 
onment 0 

in Evaluation of all Navy conducted experiments by the 
Engineering Psychology Branch of the U» S® Naval Research 
Laboratory revealed that programmed instruction in the Navy 
has one of the same faults as proven conclusively in civil- 
ians trials® If the program being presented has not been 

carefully and effectively prepared the value to be received 

3 

is next to nothing® It was decided that any Naval activity 
engaged in training could give the maximum training in aca- 
demic subjects in the minimum time if programmed instruction 
were employed® The additional time available to instructors 
could be utilized in constantly improving the programs. Fur- 
ther, it would allow instruction based upon exception — that 
is devoting instructor time to problem areas rather than 
routine matter which could be conveyed by use of programmed 
instruction. 

^Birmingham, H, P. , R® Chemikoff, and P. N. Ziegler*, 
".in equalization Teaching Machine®" Naval Research Lab. Rpt. 
3855 1 Nov® 1962;® pp. 6® 
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CHAPTER V 
CONCLUSIONS 

It Is estimated that U. S® corporations now spend as 
much as #2 billion a year to train their employees — for 
American Telephone and Telegraph alone the bill is well in 
excess of $75 million® The three million non-college grad- 
uates predicted to need professional and technical training 
in the next ten years may have to rely in part*, on industrial 
instruction*'*' Programmed instruction will be expected to 
bear an increasing amount of the training load for it is not 
just another in a long list of training fads. Proper evalu- 
ation should be made of its place in the training structure 
and the director must insure selection of adequate materials® 
This medium seems to have promise when assigned a proper 
niche® Confidence is being placed in this instrument to 
assist in solving such problems as unemployment and the 
training of displaced labor resulting from the continual 
changing technology. 

This study has shown that programmed instructions, in 
its many forms, should be an asset in most training situa- 
tions. It is not a cure-all but it has a place when properly 
evaluated and adequate programs are utilized. It is doubtful 
if a reduction of training expense will result if programmed 
instruction is used, although the amount of training and the 
educational value of the training should increase when equated 

■^Spencer Klaw, "What Can We Learn Prom The Teaching 
Machines?" The Reporter . July 19 , 1962. p. 23® 
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to the cost of programming and associated hardware * However*, 
with a significant number of trainees the cost per trainee 
could be considerably reduced. 

It is my opinion that the Bureau of Naval Personnel and 
the Naval Training Devices Center could profitably Investigate 
some of the courses presently being offered to commercial in- 
dustry. There are definitely several commercial courses that 
would have a high coorelation with training courses being of- 
fered enlisted men as a requirement for promotion. 

It would seem that the installation of some type of in- 
expensive teaching machine aboard naval ships and stations 
for presenting programmed training courses would have a po= 
tential of Increased training at a cost very little in excess 
of present expenditures. With the present trend in reduction 
of petty officer advancements *, it is essential that the in- 
creases in rate go to those who are best qualified. 

If the caliber of the candidates and the Interest dis- 
played could be increased through programmed instruction*, 
the Navy might find that it has an assist in some of the 
problems set forth in the Dillion Report (e.g. adequate main- 
tenance) . 

Increased retention in technical rates such as those 
involved in the repair of electronic instruments*, gyroes*, 
radar*, etc.*, would tend to offset the additional cost. In 
the clerical rates such as storekeeper*, yeoman*, and person- 
nelman the amount of information dispensed could be Increas- 
ed having a multiple affect In amount of retention*, one of 
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the benefits of programmed instruction. 

With additional training the talent now employed in dev- 
loping the training courses could possibly be channeled into 
programming® The cost of training programmers would be minor 
when it is spread over the number of personnel participating 
in the training programs leading to advancement in rate. 

In conclusions, it would seem that the advantages of and 
benefits to be gained from programmed instructions, both in 
the Navy and in civilian industry 9 indicate future growth® 

The objective would be to use programmed instruction as an 
adjunct to present training aids® As the science of train- 
ing progresses 9 under proper conditions program instruction 
will contribute a greater share to its efficiency® 
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APPENDIX A 



U. Sc Naval Postgraduate School 
Box 265 A 

Monteiey, California 



Dear Sir: 

Ac a partial requirement for a Master 0 $ degree in liana gensenc 
at the Uc 3* Postgraduate School , I am conduct* 5. v.g < research project 
in the application of programmed instruct 1 on a 1 ds in Industrial 
Training* 



a tt 

! o 


ached 


! survey 


is be 


a) 


500 


largest 


U, S. 






in the . 


July, 


b) 


50 


largest 


u. s 


e) 


50 


1 & i: ge s t 


u s. 


d) 


50 


largest 


u. s. 


e) 


50 


largest 


u, s. 



in the August, 1963 ics ul of FORTUNE magazine. 



I would sincerely appreciate your completing .he questionnaire 
and returning it in the f ranked self -addressed envelope- Any addi- 
tional comments you might wish to moke concerning programmed in- 
struction will be wel corned. 



If your firm does net use any type of programmed instruction 
aids, I would still appreciate a return of the questionnaire, marked 
with this fact, to determine the extent to which these aids are 
being employed. If a study has been conducted which indicates it 
would not be practical to use this type of training aid please in* 
dicate this fact in the remarks section, /All, of the questionnaire, 
programmed instruction has been employed previously and then 
andoned as not being practical please indicate in #11 



QUESTIONNAIRE FCR USE IN A SURVEY OF 
TUE APPLICATION OF PROGRAMMED INSTRUCTION AIDS 
IN INDUSTRIAL TRAINING 

1, Hay the information given in this questionnaire be quoted in the 
research paper? No attempt has been made to code any survey form* 
YES 

NO 

2* If the answer to -£1 is YES, please give your name, title and firm 
name . 

3. Vos your firm conducted a study into the feasibility of employing 
programmed ins t ruction? 

YE S 

No_ __ 

4. If YES In #3 above, what type of programmed instruction is employed? 

a) Teaching Machines 

1 ) llanuf a c ture r_ 

2) Model _ 

b ) P ro gramme d textbook s 

1) Subjects 

2) Developed by your training department 

3) Developed by outside source { e . g ♦ John Jones, 

Consultant) ___ 

4) Purchased from publishing concern 

In) Pub 1 i she r 

2a) Author 
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c ) Scrambled textbooks 

!) Subjects _ 

2) Developed by your training department^ 

3) Developed by outside source (a. g. John Jones, 

Consultant) 

{>) Purchased iron publishing concern 

la) Publisher 

2n) Author 

d) Other Type 

1) Manufacturer or Publisher 

2 ) Subjects 

5. For what type of instruction is the programmed aid used? (e.g. 

Prudential Life Insurance Ccx , uses teaching machines for instruc- 
tion of sales personnel; Hughes Aircraft uses teaching machines on 
electronics assembly line process; Sobering Drug Corporation uses 
programmed textbooks for proficiency in drug knowledge for sales 
personnel; Sell Telephone Laboratories for introductory electric- 
ity; Humble Cil Company for service station operation training; etc,). 



6* Is the programmed instruction used to supplement classroom instruc- 



tion or used solely by itself? 



75 



7 . 



Has the employement of programmed instruction permitted a reduc- 
tion of personnel used for training? 

YES 

NO 

If YES. How man y 

8. Is the student allowed to proceed at Ms own pace? 

YES 

N O 

9. Can you cite any results of; 

a) Effectiveness or lack of effectiveness of programmed instruct 
tion vs lecture training. 

b) Savings or lack of savings in training hours and/or dollars^ 



c) Training cost per student or course of instruction with pr©= 

grammed aids vs other forms of training. 

d) Employee attitude of lecture type training as contrasted to 

programmed insttuction, etc. 

10. Is the training conducted (check all that are applicable); 

a) Compulsory 

b) Voluntar y 



c) If voluntary, approximate percentage of participation 



d) On a continuing basis 

e) Upon initial employment 

f) Whenever an employee is introduced to a new function or process 



g) At regularly scheduled periods _____ 

h) During non-working hours 

11. Any additional remarks, either pro or con, which you feel would 
contribute to the research project. 
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APPENDIX 3 



1. Total Sample Size - 737 



1) 


500 


Largest 


U. 


3. Industrial Corporations. 


2) 


50 


Largest 


U. 


S. Commercial Banks. 


3) 


50 


Largest 


U. 


2 

S. Life Insurance Companies. 


4) 


50 


Largest 


U. 


2 

S. Merchandising Firms. 


5) 


50 


Largest 


U. 


So Utilities/' 3 


6) 


37 


Selected 


4 

1 Concerns. 



^ FORTUNE t, "The Fortune Directory -- The 500 Largest 
Industrial Corporations , " July 1963 * p. 177=196. 

c ' FORTUNE o "The Fortune Directory — Part II*" August 
1963. P. 139-150, 

3 17 of the Utilities listed in Fortune advised they 
were holding companies. Of this number 8 passed the 
questionnaire to a subsidiary corporation for reply and 
9 returned the questionnaire marked "not applicable 
because the number of employees would not support the 
use of programmed instructions. 

A 

Included Airlines* Railroads* and other transport* 
ation concerns* and large corporations not listed in 
Fortune because they do not divulge financial information. 



j 2. Questionnaires returned -- 504 

a) Programmed instruction is being used 


IrH 

00 


7. of 
Sample 
24.5 


7. of 
Returns 
36.0 


b) A study is being conducted but results 
are not yet available 


24 


3.3 


4.7 


c) Study is being considered and/or 
definite interest by corporation 


51 


6.9 


10.1 


d) A study has been conducted. Results 
indicate that introduction of program- 
med instruction would not be practical^ 


34 


4.6 


6.7 


e) Programmed instruction is not being usee 
there was no indication a study has beet 
conducted, and no interest shown. 


> 

214 


29.0 


42.5 


Returns 

f) No reply 

Total Sample 


504 

233 

737 


31.6 

100.0 


100% 



Reasons listed were (1) too few employees 



(2) too expensive to implement 

(3) not enough repetitive elements to warrant 
the expense of developing a program, etc. 
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APPENDIX C 
CHART I 

Questionnaire Return Recapitulation: 



Number 







Sent Out 


1. 


Industrial 


500 


2. 


Banks 


50 


3. 


Life Insurance 


50 


4. 


Utilities 


50 


5. 


Merchandising 


50 


6. 


Miscellaneous 


37 




Total Question 


737 


7. 


Unknown 





Total Returns 
8. No Reply 



Number 

Returned 


% of 

Sample 

Returned 


% of Total 
Returns by 

Class 


249 


49.8 


49.4 


30 


60.0 


5.8 


38 


76.0 


7.6 


37 


74.0 


7.5 


19 


38.0 


3.7 


N/A 1 


N/A l 


, 1 
N/A 


131 




26.0 


504 


68.4 


100.0 


233 


31.6 




737 







Miscellaneous figures for Columns 2 9 3 and 4 are included with 
Industrial. 



81 



Breakdown by Answer and Class 
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CHART III 



Breakdown of Industrial Returns by Answer 









Await- 


Not 








Being 


Inter- 


ing 


Feas- 


Not 






Used 


ested 


Study 


ible 


Used 


Total 


1. Aircraft Constr. 


6 








2 


8 


2. Heavy Equipment 


9 


3 




2 


12 


26 


3 . Aerospace 


4 


1 






2 


7 


4. Drugs 


7 


1 






4 


12 


5, Petroleum 


9 


1 


2 


1 


4 


17 


6. Office Equip. 


3 






1 




4 


7. Household 














Appliances 


2 










2 


8. Electronics 


8 






1 


4 


13 


9. Meat Packing 


1 


1 






4 


'6 


10, Chemicals 


4 


1 


1 


1 


4 


11 


11. Food Processors 


3 


3 


1 




12 


19 


12, Automotive 


3 


1 






2 


6 


13, Metals Prod'n 


5 


3 






7 


15 


14. Transportation 


6 


1 






1 


8 


15. Clothing/Cloth 




4 


1 




3 


8 


16. Electrical 


3 










3 


17. Beverage 


1 


1 




1 




3 


18. Cosmetics 


1 






1 




2 


19. Paper 


2 


1 






5 


8 


20. Packaging 


2 








4 


6 


21. Bldg. Mtrs 










5 


5 


22. Glass Products 


2 


1 




1 


2 


6 


23. Miscellaneous^ 


18 


_3 


JL 


Jt 


29 


60 


TOTALS 


99 


26 


_6 


12 


106 


249 



Industries appearing in line 23 cannot be categorized as was the 
case, in lines 1 through 22, 
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APPENDIX D 



QUESTIONNAIRE FOR USE IN A SURVEY OF 
THE APPLICATION OF PROGRAMMED INSTRUCTION AIDS 
IN INDUSTRIAL TRAINING 

1« May the Information given in this questionnaire be quoted in the 
research paper? No attempt has been made to code any survey form, 
YE S 246 Not Marke d 161 

N O 97 

2. If the answer to #1 is YES, please give your name, title and firm 
name » 

3. Has your firm conducted a study into the feasibility of employing 
programmed instruction? 

YES 139 
N O 20 

4. If YES in #3 above, what type of programmed instruction is employed? 

a) Teaching Machines Used by 88 Respondents 

1) Manufacture r See Appendix D 

2) Mode l 

b) Programmed textbooks 193 



1) 


Subjects 




2) 


Developed by outside source (e t g. John Jones, 




Consultant) 103 




3) 


Developed by your training department 


46 


4) 


Purchased from publishing concern 


125 




la) Publisher 






2a) Author 
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25 



5. 



6 . 



7 . 



c) Scrambled textbooks 

1) Subjects 

2) Developed by your training departmen t 6 

3) Developed by outside source (e.g.John Jones , 

Consul tant) 8 

4) Purchased from publishing concer n 14 
la) Publishe r 

2a) Autho r 

d) Other Typ e 9 (Taped Instruction) 

1) Manufacturer or Publishe r 2 

2) Subjects 

For what type of instruction is the programmed aid used? (e.g. 
Prudential Life Insurance Co. » uses teaching kmachines for in- 
struction of sales personnel; Hughes Aircraft uses teaching machine 
on electronics assembly line process; Schering Drug Corporation uses 
programmed textbooks for proficiency in drug knowledge for sales 
personnel; Bell Telephone Laboratories for introductory electricity 
Humble Oil Company for service station operation training; etc.) 

See Appendix G 

Is the programmed instruction used to supplement classroom instruct 
tion or used solely by itself? 



S upplement Lectures 
Sole Instruction Aid 



217 



Has the employment of programmed instruction permitted a reduction 
of personnel used for training? 



YE S 26 

N O 104 

If YES. How man y 59 
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3. Is the student allowed to proceed at his own pace? 



YES 126 
N O 21 

9, Con you cite any results of; 

a) Effectiveness or lack of effectiveness of programed instruction 

vs lecture training. 

b) Savings or lack of savings in training hours and/or dollar s 

c) Training cost per student or course of instruction with program- 
med aids vs other forms of training. 

d) Employee attitude of lecture type training as contrasted to pro- 
grammed instruction, etc. 

Outstanding Examples Cited In Chapter III 
10, Is the training conducted (check all that are applicable); 

a) Compulsor y 108 

b) Voluntar y 85 

c) If voluntary, approximate percentage of participatio n 18 cited 
Percentages From 10% to 93% Average 61%. 

d) On a continuing basi s 61 

e) Upon initial employmen t 52 

f) Whenever an employee is introduced t® a new function or process 

41 

g) At regularly scheduled period s 47 

h) During non-working hours 43 

i) During working hour s 21 

11. Any additional remarks, either pro or con, which you feel would con- 
tribute to the research project. 

Outstanding examples cited in Chapter III, 
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APPENDIX E 



Teaching Machines 
Trade Narae 

1. Videosonic 

2. Autc Tutor 
Mark II 

3 . Minimax 
Model II 

4. Uni vox 

5. Edex 

6. Nortronics 

7. National 
Foremen 

8. KOG-7 

9. ACS Portable 

10. DIDAK 501 



Cited As Being Used: 1 





Nr. 


of conce 


Manufacturer 


Type using 


Hughes Aircraft Co. 


Projected 
Media: Key 
Response 


8 


USI Western 


Projected 


13 


Design 


Media: Key 




- 


Response 




Teaching Mtrs 


Printed 


16 


Corporation 


Media: 




(Grolier) 


Written 

Response 




Universal 


Printed 


1 


Electronics 


Media: 




Lab or 1 S c : ias 


Written 




Corp. 


Response 




Edex 


Classroom 
Communication 
Sys. (4 choice 
resps & Auto- 
mated Paper Rl) 


2 


Nortronics Div. 


Audio-Visual 


3 


of Northrop Corp. 


Type Machine 
v?ithout Re- 
sponse Mcch'm 




Nat’l Foremen's 


Printed Media: 


13 


Institute(div of 


Written Resp- 




Prentice-Hall , Inc) 


onse 




Koncept-O-Graph 


Printed Media: 


6 


Corp. 


Written Re- 
sponse 




Applied Communi- 


Audio-Visual 


1 


cations Sys. (Div. 


Type machine 




of Litton Sys. Inc.) without 

Response 

Mechanism 




Rheem Cali^ons 


Printed Media: 


1 


0 orp * 


Written Re- 
sponse 
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11. DIDAK 601 



1 



12. Besseler= 
Salesmate 



Rheem Cal if one 
Corp. 



Printed Media? 
Key response 



? 



7 



2 



13. 


Key Punch Trainee 


Rheem Electronics 


Computer Con- 
trolled psycho- 
motor Device 


14. 


Auto Tutor Mark I 


USI Western 
Design 


Projected Media: 
Key Response 


15. 


Audio Graphic 
Instructor 


Graflec, Inc. 


Audio-Visual 
Type W/0 Re- 
sponse. Mech- 
anism 


16. 


Autoguide 


Radio Corp. 
of America 


Audio-Visual 
Type W/0 Re- 
sponse Mech- 
anism 


17. 


Mast 143 


Mast Dev. Co. 


Linear Device 
Using Filmstrip 
& Sound w/Option- 
al Branching 


18. 


Tachden 


Aeronutronic 
(Div. of Ford 
Motor Co.) 


Digital Com- 
puter Frogram 


19. 


Mentor 


Thompson Ramo 
Wooldridge 


Printed Media: 
Key Response 


20. 


Name Not 
Given 







4 



1 

3 



1 



1 



1 

8 



Total concerns Using Teaching Machines gg 



Information regarding Trade Name; Manufacturer, and Type taken 
from: U. S. Department of Health, Education and Welfare. Teaching 

Machines and Programmed Learnin g. (Washington, D. C. : Office of 

Education, Health and Welfare, 1962. p. 35=49 and 72=80. 
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APPENDIX F 



PUBLISHERS OF TEXTBOOKS AND SCRAMBLED TEXTBOOKS CITED IN 

QUESTIONNAIRE RETURNS : 1 ’ 2 

lo Basic Systems Inc. 

2. Center For Programmed Instruction 

3. Doubleday 6c Company, Inc. 

4. Encyclopaedia Britannica Films 

5. General Atronics Corporation 

6. General Education, Inc. 

7. General Programmed Teaching, Corp. 

8. Hamilton Research Associates 

9. Harcourt, Brace 6c World, Inc. 

10. Holt Rinehart 6c Winston, Inc. 

11. Institute of International Research 

12. International Teaching Systems 

13. Learning, Inc. 

14. The MacMillan Company 

15. Management Research Associates 

16. McGraw Hill Book Company 

17. New York Institute of Technology 

18. Radio Corporation of America 

19. Seminar, Inc. 

20. Sigma Press 

21. Science Research Associates 

22. Teaching Machines Inc. 

23. TOR Education, Inc. 



90 



24. Van Valkenburgh, Nooger 6c Neville 
25o William Barton Marsh Co. , Inc. 

26. John Wiley 6c Sons, Inc. 



Information On Courses And Publishers is Available In: U- S. 

Department of Health, Education and Welfare. Teaching Machines and 
Programmed Learning . Washington, D. C. : Office of Education, U. S. 

Department of Health, Education and Welfare, 1962. p. 52-80. 

2 

Many firms did not cite publishers of textbooks used and others 
indicated their material was developed by consultants. 
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APPENDIX G 



Courses being taught with the aid of programmed instruction as cited in 
returned questionnaires: 



Number of 
c once tm 

Course using 

1. Vectors 1 

2. Indoctrination* 4 

3. Preliminary Job Training* 17 

4. Retraining* 24 

5. English/Grammar 25 

I 

6. Office Procedures 80 

7. Mechanical Processes* 6 

8. Management Training* 34 

9. Computer Programming 28 

10. Sales Training (Retail & Wholesale)* 62 

11. Customer Training* 7 

12. Electricity 33 

13. Photography 5 

14. Electronics* 58 

15. Supervisory Training 42 

16. Algebra 25 

17. Basic Mathematics 9 

18. Geometry 7 

19. Physics 6 

20. Trigonometry 

21. Safety Practices* 5 
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22 . Use of the Slide Rule 4 

23 . Cost Control 15 

24. PERT/CPM 39 

25. Engineering Drawing 4 

26. Blueprint Reading 2 

27. Calculus 8 

28. Statistics 12 

29. Gyro Fundamental s /Servo Mechanisms 5 

30. Hostess Training 4 

31. Plant Protection 11 

32. P^.-ing 7 

33. Chemistry 7 

34. PRIME 6 

35. Tax Computation 1 

36. Psychology 2 

37 . Inventory Control 8 

38. Product Knowledge 1 33 

39. Numbers 13 

40. Navigation 4 

41 . Logic 1 

42. Business Data Processing Problems 3 

43. Refining Processes 4 

44. Executive Practices Programs 4 

45. Fundamentals of Human Physiology 3 

o 

48. Armament Systems (Air Force) 1 

47, TV Characteristics 2 
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48. Service Station Operation Training 1 

49. Foreign Languages (Job Training) 3 

50 o Foreign Languages (Off Duty Training) 2 

51. Economic Analysis 3 

52. Inertial Guidance 2 

53. Human Motivation 1 

54. SAGE Programming 1 

55. Boolean Algebra 5 

56. Basic Computer Technology 3 

2 

57. Fleet Balistics Missile Mechanics (U. S, Navy) 1 

2 

58. Sonar Operator Sounds (U. S, Navy) I 

2 

59. Radio Code (U. S, Navy) 1 



Total Courses Reported 712 



For the sake of brevity many programs have been included under 
a general heading. (e.g. Office Procedures includes filings key 
punch operation, accounting, clerical machine operation, credit 
practices, switchboard operation, etc.; Sales Training includes 
such diverse industries as drug, insurance, rubber products, etc.), 

2 

Both the United States Navy and United States Air Force have 
many more courses that employ programmed instruction but they have 
been included under general titles such as electronics, electricity, 
computer programming, inventory control, etc. 
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